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Papers  in  this  series  have  resulted  from  technical 
activities  of  the  Hydrologic  Engineering  Center. 
Versions  of  some  of  these  have  been  published  in 
technical  journals  or  in  conference  proceedings. 
The  purpose  of  this  series  is  to  make  the  infor> 
nation  available  for  use  in  the  Center's  training 
program  and  for  distribution  within  the  Corps  of 
Engineers. 


Question  46  -  "Preliminary  Planning  of  Oam  Developments" 

(a)  Practical  applications  of  systems  analysis  to  siting 
and  sizing  of  reservoirs. 

SIZING  FLOOD  CONTROL  RESERVOIR  SYSTEMS* 

BY  SYSTEMS  ANALYSIS 

1  i>y  2 

Bill  S.  Elchert'  and  Darryl  W.  Davis 

United  States  Comnlttee  on  Large  Dams 

INTRODUCTION 

•  '■'J 

Flood  control  reservoir  systems  are  designed  to  reduce  the 
Intensity  of  flooding  In  flood  plains  to  acceptable  levels.  Planning 
flood  control  reservoir  systems  requires  analysis  of  bas1n>w1de  hydrol¬ 
ogy,  Individual  reservoir  and  system  operation,  and  system  performance 
In  reducing  Intensity  of  flooding.  Sizing  reservoir  systems  (system 
formulation)  Includes  the  major  tasks  of  selecting  system  components 
from  among  competing  alternatives  and  determining  the  flood  control 
storage  within  each  reservoir.  Selection  of  system  components  (con¬ 
figuring  the  system)  Is  the  key  element  In  the  analysis.  This  paper 
focuses  upon  reservoirs  as  flood  control  measures,  but  It  should  be 
emphasized  that  non-reservoir  measures,  such  as  levees  and  channel 
work  can  form  Invaluable  system  components. 

Analysis  of  the  performance  of  alternative  flood  control  systems 
Is  greatly  complicated  by  the  system  Interaction  that  can  occur  among 
system  components.  One  of  the  Important  Interactions  In  a  system 
- 

*  Director,  The  Hydrologic  Engineering  Center  and  Chief,  Planning 
Analysis  Branch,  The  Hydrologic  Engineering  Center,  U.S.  Army 
Corps  of  Engineers,  Davis,  California. 

*  Prepared  for  Presentation  at  the  XII  International  Commission 
on  Large  Dams  Congress,  Mexico  City,  March  1976. 


occurs  when  a  number  of  reservoirs  are  being  operatcKi  for  common 
locations  and  are  thus  able  to  take  advantage  of  inflow  and  release 
timing  effects. 


Because  of  the  large  number  of  alternative  systems  possible  In 
complex  river  basins  and  due  to  the  complexity  of  evaluating  each 
system.  It  Is  essential  that  a  reasonably  structured  system  formula¬ 
tion  strategy  be  adopted  as  the  framework  for  analysis.  Since  many 
Important  concerns  other  than  hydrologic  and  economic  performance 
are  ultimately  Involved  In  the  selection  of  systems  for  Implementa¬ 
tion,  automated  optimization  methodologies  do  not  presently  play 
major  roles  In  formulation  of  large  complex  systems. 


Application  of  a  practical  flood  control  reservoir  system  simula¬ 
tion  model  that  yields  detailed  system  operation  of  all  components 
and  summarizes  hydrologic  and  economic  performance  and  costs  greatly 
assists  In  determining  system  performance.  To  perform  the  simula¬ 
tion,  the  model  accepts  data  on  (1)  historical  or  synthetic  flood  hydrol¬ 
ogy.  (2)  reservoir  system  storage  and  operating  criteria,  (3)  reservoir 
costs,  and  (4)  damage  potential  at  system  control  points. 


This  paper  discusses  the  scope  of  reservoir  system  formulation. 


modeling  flood  control  systems,  criteria  and  strategies  for  system 
formulation  and  Illustrates  the  concepts  with  applications  In 


recent  systems  studies. 
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SCOPE  OF  RESERVOIR  SYSTEM  FORfWLATIOM 


The  systens  viewpoint  adopted  herein  focuses  on  the  physical 
representation  of  the  system  and  the  system  performance.  In  partic¬ 
ular  hydrologic  and  economic  performance.  For  the  present  discus¬ 
sion  the  social,  political.  Institutional  and  environmental  aspects 
arc  assumed  to  act  on  the  system  (determining  acceptable  performance 
criteria  and  alternatives)  rather  than  comprising  Integral  parts  of 
the  analysis. 

The  physical  representation  of  alternative  systems  Is  deter¬ 
mined  by  the  potentially  useful  reservoir  sites,  and  locations 
(termed  control  points)  for  which  the  systems  are  operated.  Potential 
reservoir  sites  are  determined  by  analysis  of  the  physical  configura¬ 
tion  of  the  topography,  physical  and  geologic  characteristics  of 
the  landscape  and  their  proximity  to  potential  damage  centers.  For 
purposes  of  system  formulation,  a  reservoir  site  Is  therefore 
characterized  by  a  physical  location  (distance  from  points  of 
Interest),  site  storage-elevation  relationship  and  the  construc¬ 
tion,  operation  and  maintenance  costs  necessary  to  create  the  reser¬ 
voir  for  a  range  of  flood  control  storages.  The  stream  system  com¬ 
prises  a  second  Important  element  in  the  physical  configuration  of 
systems.  The  stream  system  can  be  characterized  by  the  "topology" 
(where  water  flows  from  and  to)  and  hydrologic  routing  criteria  that 


determines  the  conveyance  and  flow  timing  characteristics  of  the 
system.  The  hydrology  of  the  region  (nature  and  severity  of  floods) 
represents  the  complex  rainfall -runoff  relationships  and  can  be 
characterized  by  either  historic  streamflow  or  synthetic  flood 
events. 

The  performance  of  the  system  Is  measured  by  the  ability  to 
reduce  the  Intensity  of  flooding.  The  reduction  In  the  intensity 
of  flooding  can  be  viewed  from  both  economic  and  public  :^afety  or 
risk  viewpoints.  Economically,  the  performance  can  be  measured 
by  the  reduction  In  the  expected  value  of  annual  damages.  Risk 
refers  to  the  chance  (probability)  of  being  flooded.  The  risk 
performance  Is  commonly  referred  to  as  the  degree  of  protection. 

The  economic  characterization  of  the  system  is  accomplished  by 
assigning  the  damage  potential  of  reaches  of  streams  In  the  basin 
to  Index  locations  (termed  damage  centers'  that  usually  are  coin¬ 
cident  with  the  'control  points'  referred  to  previously.  The  deter¬ 
mination  of  expected  annual  damages  requires  coordination  of  the 
damage  potential  v/ith  the  flow  exceedence  frequency  relationships. 

The  flow  exceedence  frequency  relationships  are  also  needed  to 
determine  residual  risk. 

The  scope  of  the  'system'  therefore  includes  the  physical  repre¬ 
sentation  of  the  system,  (sites,  storage,  costs,  stream  conveyance 
and  basin  hydrology)  and  the  economic  representation  of  consequences 
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of  flooding  (damage  centers,  damage  potential,  frequency  of  flooding). 
The  'flood  control  system*  to  be  formulated  consists  of  the  reser¬ 
voirs  and  their  operating  characteristics.  System  formulation  Is 
pursued  by  manipulating  the  components  of  the  'system',  e.g.,  the 
size  and  location  of  reservoirs  and  observing  the  different  effects 
on  the  other  system  elements,  e.g.,  hydrology,  costs,  benefits,  and 
performance. 

Reservoir  flood  control  systems  offer  great  opportunities  for 
multi-purpose  development.  Joint  reservoir  costs  can  be  shared  for 
such  purposes  as  water  supply,  lov/  flow  regulation,  and  hydropower 
generation.  To  the  extent  the  flood  runoff  Is  seasonal,  joint  use 
may  be  made  of  storage  space  within  the  reservoir.  Even  though  most 
reservoir  projects  that  become  system  components  are  multi-purpose, 
this  paper  will  focus  of  necessity  on  reservoir  flood  control  as  If 
It  were  a  separable  feature  of  multi-purpose  systems.  Integration 
of  other  purposes  into  a  multi-purpose  system  Is  obviously  desirable 
and  requires  a  similar  systems  viewpoint  and  analysis  framework  for 
each  purpose. 


MODELING  FLOOD  CONTROL  SYSTEMS 

Simulation  of  the  operation  and  performance  of  flood  control 
systems  requires  that  the  physical,  economic  and  hydrologic  elements 
of  the  system  be  translated  to  mathematical  functions,  and  that 
these  functions  be  coded  Into  a  computer  program,  and  that  the 
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necessary  data  be  assembled  and  coded  Into  the  proper  format. 

The  major  requirements  for  modeling  a  flood  system  Include 
(1)  schematizing  the  basin  by  Identifying  operational  control  points, 
damage  Index  locations,  and  potential  reservoirs,  (2)  developing  con> 
si stent  bas1n>w1de  (control  point  by  control  point)  hydrology  that 
could  Include  one,  or  preferrably  more,  historic  events  or  synthetic 
events,  (3)  developing  streamflow  routing  criteria  for  all  stream 
reaches,  (4)  characterizing  reservoirs  by  their  storage  and  release 
capacities,  (5)  determining  operation  criteria  such  as  selecting 
control  points  to  operate  for,  determining  their  safe  flow  capacity, 
and  specifying  release  priorities,  (6)  developing  functional  damage 
relations  and  base  conditions  exceedence  frequency  relations  for 
each  damage  Index  location. 

Computer  Program  HEC-5C(1),  "Simulation  of  Flood  Control  and 
Conservation  Systems,"  has  been  developed  by  The  Hydrologic  Engineer¬ 
ing  Center,  U.S.  Army  Corps  of  Engineers,  as  a  generalized  tool  which 
can  be  used  to  simulate  any  flood  control  system.  The  program  was 
written  to  be  compatible  with  generally  accepted  analysis  procedures 
that  require  data  normally  developed  In  the  course  of  studying  flood 
control  reservoirs.  The  general  capabilities  of  HEC-5C  are  described 
below.  The  flood  control  features  are  particularly  emphasized. 

(1)  H^C-SC,  Simulation  o^  Flood  Control  and  Conservation  Systems, 
Users  Manual  (Preliminary),  The  Hydrologic  Engineering  Center, 
November  1974. 
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HEC-5C  Mas  developed  to  assist  In  planning  studies  Involving 
sizing  system  components  for  flood  control  and  conservation  require¬ 
ments.  The  program  can  be  used  In  the  planning,  design,  operation 
or  post  flood  phases  of  system  evaluation.  The  program  can  be  used 
to  calculate  the  value  of  an  existing  system  inmedlately  af'.er  a  flood 
event  to  demonstrate  the  effects  of  existing  and/or  proposed  reservoirs 
on  flows  and  damages  In  the  system.  The  program  could  also  be  useful 
In  selecting  the  proper  reservoir  releases  throughout  a  system  during 
flood  emergencies. 

The  program  simulates  the  sequential  operation  of  the  system 
components  for  any  system  configuration  for  short-time  Intervals  (such 
as  hourly)  for  historical  or  synthetic  floods  or  for  long  duration 
time  Intervals,  (such  as  monthly)  for  nonflood  periods,  or  for  coai- 
blnatlons  of  the  two.  Specifically  the  program  may  be  used  to  deter¬ 
mine: 

-  Flood  control  and  conservation  storage  requirements  for 
each  reservoir  In  the  system. 

-  The  effect  of  a  system  of  reservoirs,  or  other  structures 
on  the  spatial  and  temporal  distribution  of  runoff  In  a  basin. 

-  The  evaluation  of  flood  control  and  conservation  opera¬ 
tional  criteria  for  a  system  of  reservoirs. 

-  The  expected  annual  flood  damages,  expected  annual  benefits, 
system  costs,  and  system  net  benefits. 
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-  The  formulation  of  flood  control  systems  comprising 
reservoirs  and  other  structural  or  nonstructural  flood  management 
alternatives. 

HEC-5C  can  simulate,  depending  upon  the  computer  capacity 
available,  up  to  35  reservoirs,  75  control  points,  11  diversions 
and  9  powerplants  for  an  unlimited  number  of  time  periods  for  each 
runoff  event. 

Provided  the  limits  specified  above  are  not  exceeded,  any  system 
configuration  nay  be  specified.  Reservoirs  with  flood  control  storage 
can  be  operated  to  minimize  flooding  at  any  number  of  downstream 
control  points.  Reservoirs  with  conservation  storage  will  be 
operated  for  their  own  requirements  (power  or  low  flow)  and  can  be 
operated  for  low  flow  requirements  for  any  number  of  downstream 
control  points.  Reservoir  storage  levels  within  conservation  and 
flood  control  space  are  kept  in  balance  (in  the  same  degree  of 
trouble)  as  much  as  possible.  The  program  will  determine  all  reser¬ 
voir  releases  for  all  time  periods  but,  if  desired,  outflows  can  be 
specified  for  any  number  of  reservoirs  for  any  or  all  time  periods 
and  the  program  will  adjust  other  reservoir  releases  as  necessary. 
Constraints  at  individual  reservoirs  are  as  follows: 

-  When  the  storage  level  of  a  reservoir  is  between  the  top 
of  the  conservation  pool  and  the  top  of  the  flood  pool  (within  the 
allocated  flood  control  space),  releases  are  made  that  attempt  to 
draw  the  reservoir  down  to  the  top  of  conservation  pool  without 
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the  subsequent  release  exceeding  the  designated  channel  capacity 
at  the  reservoir. 

-  When  the  reservoir  storage  level  is  greater  than  the 
top  of  buffer  pool  (a  small  reserve  of  the  conservation  pool) 
releases  are  made  equal  to  or  greater  than  a  flow  termed  the 
minimum  desired  flow,  which  is  the  full  demand,  and  when  the  reser¬ 
voir  storage  level  is  within  the  buffer  pool  (between  the  top  of 
the  inactive  pool  and  the  top  of  the  buffer  pool)  releases  are  made 
equal  to  the  required  flow,  which  is  a  reduced  high  priority  demand. 
No  releases  are  made  when  the  reservoir  is  belovj  the  top  of  inactive 
pool.  Releases  needed  for  hydropov/er  generation  will  override 
minimum  flows  if  they  are  greater  than  the  controlling  desired  or 
required  flows. 

-  Releases  are  made  equal  to  or  less  than  the  designated 
channel  capacity  at  the  reservoir  until  the  top  of  flood  pool  is 
exceeded,  then  all  excess  flood  water  is  released  if  sufficient 
outlet  capacity  is  available.  If  insufficient  capacity  exists,  a 
surcharge  routing  is  made.  Other  optional  emergency  routines  are 
also  available. 

-  A  rate  of  flow  change  constraint  is  observed  in  that 
the  reservoir  release  is  never  greater  (or  less)  than  the  previous 
period's  release  plus  (or  minus)  a  percentage  of  the  channel  capac¬ 
ity  at  the  dam  site  unless  the  reservoir  is  in  surcharge  operation. 

Operational  criteria  for  specified  downstream  control  points 


are  as  follov/s: 
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-  Releases  are  not  made  (as  long  as  flood  storage  remains) 
Mhich  Mould  contribute  to  flooding  at  one  or  more  specified  downstream 
locations  during  a  predetermined  number  of  future  periods  except  to 
satisfy  minimum  flow  and  rate-of>change  of  release  criteria. 

-  Releases  are  made,  where  possible,  to  maintain  downstream 
flows  at  channel  capacity  (for  flood  operation)  or  for  minimum  desired 
or  required  flows  (for  conservation  operation).  In  making  a  release 
determination,  local  (Intervening  area)  flows  can  be  multiplied  by  a 
contingency  allowance  (greater  than  1  for  flood  control  and  less  than 

1  for  conservation)  to  account  for  uncertainty  In  forecasting  these 
flows. 

Operational  criteria  for  keeping  a  reservoir  system  In  balance 
are  as  follows: 

-  Where  two  or  more  reservoirs  are  In  parallel  operation  above 
a  common  control  point,  the  reservoir  that  Is  at  the  highest  Index 
level,  will  be  operated  first  to  try  to  Increase  the  flows  In  the 
downstream  channel  to  the  target  flow.  Then  the  remaining  reservoirs 
will  be  operated  In  a  priority  established  by  index  levels  to  attempt 
to  fill  any  remaining  space  In  the  downstream  channel  without  causing 
flooding  during  any  of  a  specified  number  of  future  periods. 

-  If  one  of  two  parallel  reservoirs  has  one  or  more  reservoirs 
upstream  whose  storage  should  be  considered  In  determining  the  priority 
of  releases  from  the  two  parallel  reservoirs,  then  an  equivalent  index 


level  Is  detenelned  for  the  tanden  reservoirs  (one  above  the  other) 
based  on  the  conblned  storage  In  the  tanden  reservoirs. 

-  If  tMO  reservoirs  are  In  tanden,  the  upstream  reservoir 
can  be  operated  for  control  points  between  the  two  reservoirs.  In 
addition,  when  the  downstrean  reservoir  Is  being  operated  for  control 
points,  an  attempt  Is  made  to  bring  the  upper  reservoir  to  the  sane 
Index  level  as  the  lower  reservoir. 

A  variety  of  streamflow  routing  procedures,  such  as  the  Huskingun 
and  modified  Puls  methods,  are  available  for  use.  The  hydrologic  Input 
for  flood  events  may  be  for  natural  or  observed  conditions  for  each 
control  point  or  local  contributions  between  control  points.  If 
natural  or  observed  flows  are  provided,  the  local  flows  are  computed 
and  If  local  flows  are  provided,  the  natural  flows  are  computed. 

A  single  streamflow  diversion  can  be  made  from  any  reservoir 
or  control  point  and.  If  desired,  proportions  of  the  diversion  can 
be  routed  and  returned  at  any  downstream  control  point  or  reservoir. 

Diversions  may  be  one  of  the  following  types: 

-  Diversions  that  are  a  function  of  Inflows. 

-  Diversions  that  are  functions  of  reservoir  storages. 

>  Diversions  that  are  constant. 

•  Diversions  that  Include  all  excess  water  above  the  top 
of  conservation  pool  up  to  the  diversion  facility  capacity. 
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The  progr—  can  operate  an  unllnfted  nueber  of  floods  for  a 
reservoir  system.  The  series  of  floods  can  each  start  at  different 
reservoir  storages  or  from  the  same  storages  or  can  be  continued  using 
the  storages  from  the  previous  floods.  Up  to  nine  proportions  (ratios) 
of  any  or  all  floods  may  be  operated.  Floods  extending  over  long 
periods  may  be  processed  by  dividing  the  flood  Into  flow  events  idilch 
are  each  less  than  the  program  limits.  This  may  be  done  by  manually 
setting  In  several  sets  of  flow  data  (with  each  less  than  the  allow* 
able)  or  by  allowing  the  computer  to  generate  separate  floods  (when 
the  data  read  exceeds  the  allowable  limit). 

The  program  can  operate  the  system  for  a  continuous  period  of 
record  (for  example,  20  years  of  monthly  data).  Also  a  mixture  of 
computational  intervals  may  be  used  such  as  a  monthly  operation  for 
a  few  years  and  then  operating  for  dally  or  hourly  flows  during  a 
major  flood  and  then  back  to  a  weekly  or  monthly  routing  interval. 

An  unlimited  number  of  events  can  be  simulated  in  this  manner. 

Expected  annual  flood  damages  (average  annual)  or  the  damages 
resulting  from  specific  flood  events  can  be  computed  for  up  to  nine 
damage  categories  for  any  or  all  control  points  using  one  or  more 
proportions  (ratios)  of  each  of  several  historical  or  synthetic 
floods.  Expected  annual  damages  will  be  computed  for  (1)  natural 
or  unregulated  conditions,  (2)  regulated  conditions  by  the  reservoir 
system  and  (3)  full  regulation  at  those  reservoir  sites  assuming 
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unlimited  flood  control  storage  (damage  from  the  uncontrolled  local 
flows).  Damages  calculated  for  base  conditions  (normally  natural 
flows)  using  selected  floods  and  proportions  (ratios)  are  computed  by 
Integrating  the  base  conditions  damage-frequency  curve  or  by  using 
a  predetermined  average  annual  damage.  Expected  Annual  Damages  for 
modified  conditions  are  computed  from  the  sum  of  the  products  of  the 
assigned  exceedence  frequency  Intervals  (based  on  base  conditions)  and 
the  corresponding  damage  based  on  the  modified  flow.  Figure  1. 
Expected  Annual  Damage  Computations,  graphically  portrays  the  annual 
damage  computations.  The  damage  from  the  uncontrolled  local  flows 
are  also  calculated  In  a  similar  manner  to  the  modified  conditions. 

The  damage  reduction  dye  to  the  proposed  system  Is  based  on 
the  difference  between  the  expected  annual  damages  for  the  base  condi¬ 
tions  and  the  modified  conditions.  If  there  Is  an  existing  reservoir 
system  the  damage  reduction  can  be  based  on  the  difference  between 
the  base  conditions  and  the  modified  conditions  where  the  base  condi¬ 
tions  were  determined  from  another  simulation  run  In  which  existing 
reservoirs  only  are  simulated. 

A  separate  set  of  damage  data  can  be  used  If  the  modified  condi¬ 
tion  damages  do  not  follow  the  base  condition  discharge-damage  curves 
as  would  be  the  case  for  a  levee,  channel  Improvement  or  nonstructural 
alternative  such  as  flood  proofing,  relocation,  purchase,  or  flood 
plain  zoning. 
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Fig.  1  Expected  onnuoi  damage  computation 


Cost  functions  for  construction,  operation.  Maintenance  and  replace- 
ment  and  amortization  may  be  provided  for  reservoirs  (a  function  of 
storage)  and  nonreservoirs  (a  function  of  design  discharge).  A  dis¬ 
count  rate  for  amortization  of  capital  cost  Is  also  needed. 

The  needed  Input  data  can  be  scaled  to  the  problem  under  study, 
for  example.  It  can  be  minimal  for  very  preliminary  planning  studies 
or  It  can  be  very  detailed  for  modeling  existing  systems.  The  data 
requirements  for  a  full  flood  control  system  planning  study  are: 

-  General  Information  such  as  output  labels,  simulation 
control  data  (time  periods,  computation  Intervals,  print  control,  etc.) 

-  Reservoir  capacities  at  top  of  conservation  and  top  of 
flood  control  pool  elevations,  downstream  control  points  for  which 
each  reservoir  Is  operated,  and  reservoir  storage/outflow  tables. 

-  Control  point  (Including  reservoirs)  Identification  numbers 
and  titles,  channel  capacities  (safe  flow  capacity),  and  channel  rout¬ 
ing  criteria. 

-  Inflow  or  local  flow  data  for  each  control  point  for  one 
or  more  historical  or  synthetic  floods. 

•  Peak  discharge-damage- frequency  data  for  each  damage  Index 
location:  reservoir  capital  costs  vs.  storage  or  nonreservoir  capital 
costs  vs.  design  discharge;  capital  recovery  factor,  and  annual 
operation  and  maintenance  cost  functions. 

The  program  outputs  a  listing  of  Input  data,  hydrologic  results 
of  system  operation  arranged  by  downstream  sequence  of  control  points, 
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iiydrologlc  results  of  systen  operation  arranged  by  sequence  of  time 
periods;  summary  of  flooding  for  system;  summary  of  reservoir  releases 
and  control  point  flows  by  period;  summary  of  conservation  operation 
if  monthly  routing  was  made;  summary  of  maximum  flov<fS,  storages,  etc., 
for  each  flood  event;  summary  of  maximum  and  minimum  data  for  all 
floods;  summary  of  expected  annual  damages  and  benefits;  and  summary 
of  system  costs  (capital  and  annual)  and  system  net  economic  benefits. 
Output  can  be  suppressed  to  that  of  Interest  for  a  particular  simula¬ 
tion  and  a  number  of  convenient  graphical  displays  are  available. 

FLOOD  CONTROL  SYSTEfI  FORf-IULATION 

The  objectives  of  system  formulation  are  to  (1)  Identify  the 
Individual  components,  (2)  determine  the  size  of  each,  (3)  determine 
the  order  In  which  the  system  components  should  be  Implemented,  and 
(4)  develop  and  display  the  Information  required  to  justify  the 
decisions  and  thus  secure  system  Implementation.  In  the  Interest 
of  brevity,  the  following  discussion  Is  confined  to  Identifying  the 
components  that  would  comprise  the  best  system. 

Formulation  Criteria.  -  Criteria  for  system  formulation  are 
needed  to  distinguish  the  best  system  from  among  competing  alterna¬ 
tive  systems.  The  definition  of  "best"  Is  crucial. 

a.  Viewpoint.  -  A  reasonable  viewpoint  would  seem  to 
recognize  that  simply  aggregating  the  most  attractive  Individual 
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components  Into  a  system,  while  assuring  physical  compatibility, 
could  result  In  Inefficient  use  of  resources  because  of  system 
effects,  data  uncertainty^  and  the  possibility  that  all  components 
may  not  be  Implemented.  It  Is  proposed  that  the  "best"  system  be 
considered  to  be: 

(1)  The  system  that  includes  the  obviously  good  com¬ 
ponents  (satisfy  criteria  belov/)  while  preserving  flexibility  for 
modification  of  components  at  future  dates. 

(2)  The  system  which  could  be  Implemented  at  a  number 
of  stages.  If  staging  Is  possible,  such  that  each  stage  could  stand 
on  its  own  merits  (be  of  social  value)  If  no  more  components  were  to 
be  added. 


b.  Criteria  Elements.  -  General  guidance  for  formulation 
criteria  are  contained  In  the  recently  published  Principles  and 
Standards(2).  The  criteria  of  economic  efficiency  from  the  national 
viewpoint  has  existed  for  some  time  (3)(4),  and  has  been  reemphasized 
In  (2).  This  criteria  has  been  Interpreted  to  require  that  each  com¬ 
ponent  In  a  system  should  be  Incrementally  Justified,  that  Is,  each 

component  addition  to  a  system  should  add  to  the  value  (net  benefits) 

T2)  Principles  and  Standards  for  Planning  Mater  and  Related  Land 
Resources,  Hater  Resources  Council,  published  In  the  Federal 
Register,  The  National  Archives  of  the  United  States,  September 
10,  1973. 

(3)  Proposed  practices  for  economic  analysis  of  river  basin  projects, 
a  report  to  the  Inter-Agency  Committee  on  Water  Resources  by  Its 
Subcommittee  on  Evaluation  Standards,  Nay  19S8,  "Green  Book”. 

(4)  Policies,  Standards  and  Procedures  In  the  Formulation,  Evaluation 
and  Review  of  Plans  for  Use  and  Development  of  Water  and  Related 
Land  Resources,  87th  Congress,  2d  Session,  Senate  Document  97,  1962. 
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of  the  total  syste*.  The  second  criteria  proposed  In  (2)  Is  that  of 
envIronaKntal  quality.  The  environnental  quality  criteria  can  be 
viewed  as  favoring  alternatives  that  can  be  structured  to  nlnlalze 
adverse  environmental  Impacts  and  provide  opportunities  for  mitiga¬ 
tion  measures.  Additional  criteria  that  are  not  as  formally  stated 
as  United  States  national  policy  are  Important  In  decisions  among 
alternatives.  A  formulated  flood  control  system  must  draw  sufficient 
support  from  responsible  authorities  In  order  to  be  Implemented.  In 
addition,  flood  control  systems  should  be  formulated  so  that  a  minimum 
standard  of  performance  (degree  of  risk)  Is  provided  so  that  public 
safety  and  welfare  are  adequately  protected. 

Of  these  criteria,  only  the  national  economic  efficiency  and 
minimum  performance  standard  have  generally  accepted  methods  available 
for  their  rigorous  Inclusion  In  formulation  studies.  Environmental 
quality  analysis  and  soc1a1/po11t1ca1/1nst1tut1ona1  analyses  related 
to  Implementation  have  not  developed  technology  applicable  on  a  broad 
scale.  As  a  consequence  these  criteria  must  guide  the  formulation 
studies  but  as  yet,  probably  cannot  directly  contribute  In  a  structured 
formulation  strategy.  In  discussions  that  follow,  focus  Is  of  necessity 
upon  the  economic  criteria  with  acceptable  performance  as  a  constraint, 
with  the  assumption  that  the  remaining  criteria  will  be  incorporated 
when  the  formulation  strategy  has  narrowed  the  range  of  alternatives 
to  a  limited  number  for  which  the  environmental  and  other  assessments 
can  be  performed. 
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Systaa  Formlatlon  Strategies.  -  A  system  Is  best  for  the  national 
Income  criteria  If  It  results  In  a  value  for  system  net  benefits  that 
exceeds  that  of  any  other  feasible  system.  For  a  few  components, 
analysis  of  the  number  of  alternative  systems  that  are  feasible  Is 
generally  manageable  and  exhaustive  evaluation  provides  the  strategy 
for  determining  the  best  system.  When  the  number  of  components  Is 
more  than  Just  a  few,  then  the  exhaustive  evaluation  of  all  feasible 
alternative  systems  cannot  practically  be  accomplished.  In  this 
Instance,  a  strategy  Is  needed  that  reduces  the  number  of  system 
alternatives  to  be  evaluated  to  a  manageable  number  while  providing 
a  good  chance  of  Identifying  the  best  system.  The  present  state-of> 
the-art  of  systems  analysis  does  not  permit  (In  a  practical  applica¬ 
tion)  finding  the  economic  optimum  (maximum  net  benefit  system)  for 
reasonably  complex  systems  even  with  all  hydrologic-economic  data 
known.  Since  seldom  will  the  optimum  economic  system  be  selected 
as  best,  an  acceptable  strategy  need  not  make  the  absolute  guarantee 
of  economic  optimum. 

The  Incremental  test  of  the  value  of  an  individual  system  com¬ 
ponent  Is  definitive  for  the  economic  efficiency  criteria  and  pro¬ 
vides  the  basis  for  several  alternative  formulation  strategies.  If 
existing  flood  control  components  are  present  In  the  system,  then 
they  define  the  base  conditions.  If  no  flood  control  components 
exist,  the  base  condition  would  be  for  natural  conditions.  The 
strategies  described  below  are  extensions  of  currently  used 
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techniques  and  are  based  upon  the  concept  of  examining  In  detail 
the  performance  of  a  selected  few  alternative  systems.  The  perform¬ 
ance  Is  assumed  to  be  evaluated  generally  by  traditional  methods 
that  make  use  of  HEC-5C. 

a.  Reasoned  Thought  Strategy.  -  This  strategy  Is  predicated 
upon  the  Idea  that  It  Is  possible  to  'reason*  out  by  judgement  and 
other  criteria,  reasonable  alternative  systems.  The  strategy  con¬ 
sists  of  devising  through  rational  thought,  sampling,  public 
opinion,  literature  search,  brainstorming,  etc.,  a  manageable 
number  of  system  alternatives  that  will  be  evaluated.  No  more  than 
15  to  20  alternative  systems  could  be  evaluated  by  detailed  simulation 
In  a  practical  sense.  Next,  the  total  performance  of  each  system  In 
terms  of  economic  (net  benefit)  and  performance  criteria  Is  evaluated 
by  a  system  simulation.  A  system  (or  systems  If  more  than  one  have 
very  similar  performance)  Is  selected  that  maximizes  the  contribution 
towards  the  formulation  objectives  (those  that  exhibit  the  highest 
value  of  net  benefits  while  satisfying  the  minimum  performance  criteria). 
To  confirm  the  Incremental  justification  of  each  component,  the  con¬ 
tribution  of  each  system  component  In  the  "last  added"  position  Is 
evaluated.  The  last  added  value  Is  the  difference  between  the  value 
(net  benefits)  of  the  system  with  all  components  In  operation  and 
the  value  (net  benefits)  of  the  system  with  the  "last  added"  component 
removed.  If  each  component  Is  Incrementally  Justified,  as  Indicated 
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by  the  test*  the  systea  Is  econonlcally  Justified  and  fonulatlon 
Is  conplete.  If  any  eoaponents  are  not  Incrciaen tally  Justified,  they 
should  be  dropped  and  the  "last  added*  analysis  repeated. 

The  systen  selected  by  this  strategy  will  be  a  feasible  systea 
that  Is  econoalcally  Justified.  Assuming  the  aethod  of  devising  the 
alternative  systeas  Is  rational,  the  chances  are  good  that  the  aajor 
worthwhile  projects  will  have  been  Identified.  On  the  other  hand  the 
chances  that  this  system  provides  the  absolute  maximum  net  benefits 
Is  relatively  small.  This  strategy  would  require  between  30  and  60 
systems  evaluations  for  a  moderately  complex  (15  component)  system. 

b.  First  Added  Strategy.  -  This  strategy  Is  designed  such 
that  Its  successive  application  will  yield  the  formulated  system. 

The  performance  of  the  systems,  that  Includes  the  base  components 
(If  any),  are  evaluated  with  each  potential  addition  to  the  system  In 
the  "first  added*  position.  Ibe  component  that  contributes  the 
greatest  value  (net  benefit)  to  the  system  Is  selected  and  added  to 
the  base  system.  The  analysis  Is  then  repeated  for  the  next  stage 
by  computing  "first  added"  value  of  each  component  to  the  system 
again,  the  base  now  Including  the  first  component  added.  The  strategy 
Is  continued  to  completion  by  successive  application  of  the  first 
added  analysis  until  no  more  component  additions  to  the  system  are 
Justified. 


Table  1  contains  Information  adapted  from  a  recent  study  and 
Illustrates  the  strategy.  Components  A>J  are  candidates  for  Inclusion 
within  a  system.  Components  A,  C,  and  E  have  already  been  Implemented. 
Stage  1  represents  the  'first  added*  value  of  the  candidate  system  com¬ 
ponents.  The  Incremental  value  (net  benefits  added)  by  component  F  Is 
the  largest  so  It  Is  selected  for  Inclusion  In  the  system.  Stage  2 
represents  the  'first  added'  value  of  the  components  with  the  base 
system  now  comprised  of  components  A»  C,  E»  and  F.  Note  that  many 
of  the  values  change  because  of  system  effects.  Component  J  Is 
selected  for  addition  to  the  system.  The  remainder  of  the  table 
contains  the  analysis  through  to  completion.  Note  that  22  first 
added  analyses  were  made  In  the  four  stages  required  to  select  three 
new  projects  out  of  seven  alternatives.  Exhaustive  consideration  of 
all  possibilities  would  have  required  127  analyses  whereas  If  all 
components  had  proven  to  be  valuable  additions  to  the  system,  28 
first  added  analyses  would  have  been  necessary. 
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TABLE  li^ 

FIRST  ADDED  FORMULATION  STRATEGY 


Component 

A* 

B 

C* 

0 

E* 

F 

G 

H 

I 

J 


First  Added  Value  (S1000  per  year) 


Stage  1 

Stage  2 

Stage  3 

Stage  4 

Formulated 

System 

20 

mm 

5 

mm 

-2 

mm 

-8 

X 

— 

mm 

*  w 

— 

X 

16 

16 

16** 

— 

X 

«« 

mm 

— 

— 

X 

35** 

-10 

6 

-2 

mm 

0 

-12 

-2 

0 

-12 

-2 

0 

-15 

-2 

X 

15 

18** 

■iW> 

X 

^First  added  value  Is  system  net  benefits  with  the  component  added 
minus  system  net  benefits  without  the  component  added. 


*  Signifies  existing  system  component.  **  signifies  system  addition 


The  strategy  does  have  a  great  deal  of  practical  appeal  and 
probably  would  accomplish  the  Important  task  of  Identifying  the  components 
that  are  clearly  good  additions  to  the  system  and  that  should  be  Imple¬ 
mented  at  an  early  stage.  The  strategy,  however.  Ignores  any  system 
value  that  could  be  generated  by  the  addition  of  more  than  one  compo¬ 
nent  to  the  system  at  a  time  and  thus  could  omit  potentially  useful 
additions  to  the  system.  For  example,  the  situation  sometimes  exists 
where  reservoirs  on  say  two  tributaries  above  a  damage  center  are 
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Justified  but  either  one  analyzed  separately  Is  not,  I.e.,  the  systeai 
effect  Is  great  enough  to  Justify  both.  The  nunber  of  systems  analysis 
required  to  formulate  a  system  based  on  this  strategy  could  range  up* 
wards  to  120  evaluations  for  a  moderately  complex  (15  component) 
system,  which  Is  probably  close  to  being  an  unmanageably  large  number 
of  evaluations. 

c.  Last  Added  Strategy.  This  strategy,  similar  to  b.  Is 
designed  such  that  successive  application  yields  the  formulated  system. 
Beginning  with  all  proposed  components  to  the  system,  the  value  of 
each  component  In  the  "last  added"  position  Is  computed.  The  project 
whose  deletion  causes  the  value  (net  benefit)  of  the  system  to  Increase 
the  most  Is  dropped  out.  The  net  benefits  would  Increase  If  the  com* 
ponent  Is  not  Incrementally  Justified.  The  strategy  Is  continued 
through  successive  staged  applications  until  the  deletion  of  a  com* 
ponent  causes  the  total  system  value  (net  benefits)  to  decrease. 

Table  2  contains  Infonnatlon  adapted  from  a  recent  study 
and  Illustrates  the  strategy.  Components  K*T  are  candidates  for 
Inclusion  within  a  system.  Components  L,  P,  and  R  have  already 
been  Implemented.  Stage  1  represents  the  ’last  added'  value  of 
the  candidate  system  components.  The  Incremental  value  (net 
benefits  lost)  by  adding  component  Q  In  the  last  position  Is  the 
greatest  (*30)  so  It  Is  selected  for  deletion  from  the  system. 

Stage  2  represents  the  'last  added'  value  of  the  components  with 
the  base  system  now  excluding  component  Q.  Note  that  a  number 
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of  the  values  have  changed  because  of  systeai  effects.  CoMponent  K 
Is  selected  for  deletion.  The  reMinder  of  the  table  contains  the 
analysis  through  to  coBg>1et1on. 


TABLE  2^ 

LAST  ADDED  FORMULATION  STRATEGY 


Last  Added  Value  (S1000  per  year) 


Component 

Stage  1 

Stage  2 

Stage  3 

Stage  4 

Formulated 

System 

K 

-20 

-10** 

•• 

— 

L* 

— 

— 

— 

X 

M 

10 

0 

-4** 

•  • 

N 

6 

6 

6 

8 

X 

0 

8 

8 

8 

12 

X 

P* 

— 

mm 

— 

X 

0 

-30** 

mm 

— 

— 

R* 

— 

— 

— 

— 

X 

S 

0 

-6 

12 

10 

X 

T 

-2 

0 

0 

2 

X 

^Last  added  value  Is  system  net  benefits  with  the  component  In  the 
system  minus  system  net  benefits  without  the  component  added. 

*  Signifies  existing  system  component  and  **  system  component  that 
Is  dropped. 


This  strategy  Mill  also  yield  a  system  In  which  all  components  are 
Incrementally  Justified  and  In  which  the  total  system  will  be 
Justified. 
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This  strategy  «(0u1d  probably  Identify  the  obviously  desirable 
projects,  as  trauld  the  others.  However,  Its  weakness  Is  that  It  Is 
possible,  though  not  too  likely,  that  groups  of  projects  that  would 
not  be  Justified  are  carried  along  because  of  their  complex  linkage 
with  the  total  system.  For  example,  the  situation  sometimes  exists 
where  reservoirs  on  say  two  tributaries  above  a  damage  center  are  not 
Justified  together  but  deletion  of  each  from  a  system  that  Includes 
both  results  In  such  a  great  loss  In  system  value  that  Individual 
analysis  Indicates  neither  should  be  dropped  Individually. 

The  number  of  systems  analysis  required  for  this  strategy 
would  be  similar  to  the  first  added  strategy  requiring  perhaps  10>20X 
more  evaluations.  Twenty-two  last  added  analyses  were  made  In  the 
four  stages  required  to  select  four  new  projects  out  of  seven  alter¬ 
natives.  This  strategy  Is  more  efficient  than  the  'first  added*  If 
the  majority  of  the  potential  system  additions  are  good  ones. 

d.  Strategy  Discussion.  -  Each  of  the  strategies  presented 
had  one  or  another  shortcoming.  If  the  system  were  formulated  using 
the  'first  added*  strategy,  then  formulated  using  the  'last  added* 
strategy  and  the  formulated  systems  come  out  to  be  Identical,  the 
best  system  probably  would  have  been  formulated.  It  Is  possible, 
however,  that  the  'first  added'  system  would  not  include  some 
feasible  projects  and  that  the  'last  added*  system  would  Include 
some  that  are  not  valid  system  components  as  described  previously. 

One  approach  to  arrive  at  the  formulated  system  would  be  to  formulate 
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alternative  systems  ccMprIsIng  the  coinon  components  from  both 
systems  (all  of  the  first  added)  and  logical  combinations  of  those 
additional  components  Included  In  the  'last  added*  formulation. 

The  strategy  described  as  "reasoned  thought"  could  make  a  meaningful 
contribution  at  this  stage. 

A  reasonable  working  strategy*  as  a  framework  that  need  not 
be  rigid*  would  be  to  apply  the  first  and  last  added  strategies 
through  sufficient  stages  to  Identify  and  screen  out  those  compo- 
nents  that  are  obviously  good  and  obviously  inferior  and  zero  In  on 
the  system  to  be  selected  using  a  reasoned  thought  approach. 

SENSITIVITY  ANALYSIS 

There  will  be  varying  degrees  of  uncertainty  In  the  Information 
used  In  system  formulation.  The  hydrology  will  be  better  defined 
near  gaging  stations  than  It  Is  In  remote  areas*  and  certain 
potential  reservoirs  will  have  been  more  thoroughly  investigated 
than  others.  In  addition  the  accuracy  of  economic  data,  both  costs 
and  value,  existing  or  projected,  is  generally  lower  than  the  more 
physically  based  data.  Also*  conditions  change  over  time  and  thus 
the  data  must  be  continuously  updated  at  each  decision  point.  The 
practical  acconmodation  of  information  uncertainty  Is  by  limited 
sensitivity  analysis  and  continuing  reappraisal  as  each  component 
of  a  system  is  studied  for  Implementation. 
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Sensitivity  analysis  has  as  Its  objective,  the  Identification 
of  either  (1)  critical  elements  of  data,  or  (2)  particularly 
sensitive  system  components,  so  that  further  studies  can  be  directed 
toward  firming  up  the  uncertain  elements  or  that  adjustments  In 
system  formulation  can  be  made  to  reduce  the  uncertainty. 

Because  of  the  particular  method  used  In  HEC-5C  to  develop 
regulated  conditions  frequency  relations  at  damage  Index  stations, 
particular  attention  must  be  paid  to  selection  or  development  of 
the  system  hydrology.  The  problem  arises  when  evaluating  complex 
reservoir  systems  with  many  reservoirs  above  coninon  damage  centers; 
the  problem  also  Increases  with  the  size  and  complexity  of  the  basin. 
There  are  a  large  number  of  storm  centerings  that  could  yield  similar 
flows  at  a  particular  control  point.  Because  of  this,  the  contrlbu* 
tion  of  a  specific  system  component  to  reduced  flooding  at  a  down¬ 
stream  location  Is  uncertain  and  dependent  upon  storm  centering. 

This  makes  the  selection  or  development  of  "representative"  center¬ 
ings  crucial  if  all  upstream  components  are  to  be  evaluated  on  a 
comparable  basis.  The  desired  evaluation  for  regulated  conditions 
Is  the  "expected"  or  average  condition  so  that  economic  calculations 
are  valid.  The  representative  hydrograph  procedure  used  in  HEC-5C 
where  several  proportions  (ratios  of  one  or  more  historic  or  synthetic 
events  Is  used  to  represent  system  hydrology)  Is  compatible  with 
the  simulation  technique  used  but  care  must  be  taken  to  reasonably 
accommodate  the  storm  centering  uncertainty. 


Testing  the  sensitivity  of  the  expected  annual  damages  to  the 
system  hydrology  (event  centering)  Is  appropriate  and  necessary.  The 
alternative  to  the  representative  hydrograph  procedure  Is  the  use  of 
all  historical  floods  of  record.  However  even  this  more  laborious 
process  may  Introduce  some  bias  In  computing  expected  annual  damages 
If  most  historical  floods  were,  by  chance,  centered  over  a  certain 
part  of  the  basin  and  not  over  others.  For  Instance  one  reservoir 
site  may  have  experienced  several  severe  historical  floods  while 
another  site  Immediately  adjacent  to  that  area  may.  due  to  chance, 
not  have  had  any  severe  floods. 

While  It  Is  possible  In  the  program.  HEC*5C.  to  use  only  a  single 
flood  event  and  several  proportions  (ratios)  of  that  flood  In  computing 
expected  annual  damages,  this  procedure  could  Introduce  considerable 
bias  In  the  results.  A  good  approach  Is  to  use  several  historical 
floods  with  storm  centerings  throughout  the  basin  and  to  use  several 
proportions  of  those  floods  to  obtain  flows  at  the  damage  centers 
representing  the  full  range  of  the  flow-frequency-damage  relationship 
for  base  conditions  and  for  regulated  conditions.  Another  approach 
Is  to  synthesize  events  that  have  consistency  In  volumes  of  runoff  and 
peak  flows  and  be  reasonably  representative  regarding  upstream  con¬ 
tribution  to  downstream  flows.  Table  1  contains  sensitivity  Information 
developed  In  studies  of  the  Susquehanna  Basin.  Pennsylvania. 
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TABLE  1 


SUSQUEHANNA  FLOOD  CONTROL  REVIEW  STUDY 
FLOOD  EVENT  SENSITIVITY  ANALYSIS 

Expected  Annual  Damage  Reduction 
(1,000  1974  Dollars) 


Reservoir 

System 

Hydrology 

A 

Hydrology 

B 

Hydrology 

C 

Hydrology 

D 

Hydrology 

E 

Existing 

Reservoirs 

26,251 

37,462 

39,103 

33,805 

36,633 

112  East 
Guilford* 

950 

4,275 

2,377 

1,981 

2,538 

155  Towanda* 

3,846 

653 

573 

124 

632 

1902  Slnnema- 
honlng* 

5,674 

5,384 

5,798 

2,727 

4,649 

*  Damage  reduction  In  first  added  (to  existing  system)  position. 

**  Hydrology  A  -  Tropical  Storm  Agnes  (June  1972)  used  as  the  repre¬ 
sentative  event,  nine  proportions  (ratios)  Mere  used  to  cover 
range  of  damaging  floods. 

Hydrology  B  -  A  Standard  Project  Flood  (SPF)  (a  synthetic  event 

centered  lower  In  the  basin  (Harrisburg,  PA))  used  as  the  repre¬ 
sentative  event,  also  nine  ratios  used. 

Hydrology  C  -  A  synthetic  event  representing  a  10-Inch  storm  spread 
uniformly  over  the  basin,  seven  ratios  used. 

Hydrology  D  -  March  1936  flood  (flood  of  record  In  many  areas  of 
basin)  used  as  representative  event,  six  ratios  used. 

Hydrology  E  -  Adopted  system  hydrology  consisting  of  two  ratios 

each  of  Agnes,  the  SPF,  the  10-Inch  uniform  and  the  1936  flood. 


The  Impact  on  system  formulation  of  the  general  level  of  damage 
assessment,  discount  rates  and  costs  are  greatly  dependent  upon  the 
relative  variation  In  the  system.  For  Instance,  difference  In 
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discount  rates  (higher  for  exemple).  If  unlfons  for  all  systea 
coaponents,  trill  generally  not  affect  the  relative  attractiveness 
(one  to  another)  but  trill  affect  the  overall  attractiveness  of  the 
systea.  Daaage  potential,  because  It  becoaes  Integrated  with  hydro1> 
ogle  and  hydraulic  data  to  yield  expected  annual  daaages,  aust  change 
significantly  aaong  control  points  before  aajor  differences  In  systea 
foraulatlon  would  result.  This  Is  not  the  situation  which  exists  for 
costs,  they  enter  the  analysis  directly  and  thus  should  receive, 
relatively  speaking,  aore  attention  In  accoanodating  uncertainty  In 
systea  formulation. 

SUttMRY 

The  systems  viewpoint  applied  to  reservoir  flood  control  systems 
Includes  the  physical  representation  of  the  system  (sites,  storage, 
costs,  stream  conveyance,  basin  hydrology)  and  the  economic  representa> 
tion  of  the  consequences  of  flooding  (damage  centers,  damage  potential, 
frequency  of  flooding).  The  flood  control  system  to  be  formulated  con¬ 
sists  of  the  reservoirs  and  their  operating  characteristics.  Computer 
Program  HCC-5C,  "Slnnjlatlon  of  Flood  Control  and  Conservation  Systems," 
has  been  developed  by  The  Hydrologic  Engineering  Center  as  a  general¬ 
ized  tool  which  can  he  used  to  simulate  any  flood  control  system. 

The  program  was  written  to  be  compatible  with  generally  accepted 
analysis  procedures  that  require  data  normally  developed  In  the 
course  of  studying  flood  control  reservoirs. 
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A  fomuUtlon  strategy  that  Identifies  the  obviously  good 
systeM  conponents  while  preserving  flexibility  for  future  changes 
Is  desirable.  A  practical  working  strategy,  based  on  successive 

j 

Increnental  evaluations  of  the  value  of  systeo  conponents,  would  be 
to  apply  the  first  and  last  added  tests  through  sufficient  stages 
to  Identify  and  screen  out  those  conponents  that  are  obviously  good 
and  obviously  Inferior  and  zero  In  on  the  system  to  be  selected  by 
logical  combinations  of  the  remaining  projects. 

Because  of  the  uncertainty  contained  In  the  Information  used 
In  system  formulation.  It  Is  essential  that  limited  sensitivity  analysis 
be  conducted  that  Is  designed  to  Identify  Information  Inadeguacles  and 
senstitive  system  components.  In  addition  continuing  reappraisal  of 
Information  Inadequacy  as  each  component  of  a  system  Is  studied  for 
Implementation  Is  necessary. 


